Multimodal Designation : Experimental Data on User Strategies
Identifieur interne : 00D456 ( Main/Exploration ); précédent : 00D455; suivant : 00D457Multimodal Designation : Experimental Data on User Strategies
Auteurs : N. Carbonell ; Jean-Marie Pierrel [France]Source :
Abstract
We have designed an experiment on the `Wizard of Oz' paradigm. Ten subjects interacted with various standard applications (MacDraw, Word,...) through a dialogue interface which includes\, : \begin{itemize} \item[-]software driven keyboard and graphical display \item[-]simulated speech input and output \item[-]a touch panel (for 2xD selection and drawing) with additional simulated functions. \end{itemize} Experimental results are discussed with respect to the following issues\, : \begin {itemize} \item[-]to what extend does multimodality influence user designation strategies ? Does speech play as prominent a role here as in human dialogue ? Is anaphora used as frequently ?... \item[-]How do subjects combine speech and pointing (concurrently or sequentially) ? Do they associate deictics with gestures ? Or do they replace words such as ``her{e}'', ``this'', etc., by pointing ? \item[-]At which level should incoming information from various modes be synchronized and merged ? What form and granularity should be resulting unified representation take ? \item[-]Are current models of linguistic reference mechanisms (cf. for instance, Sidner's and Grosz's models) applicable in a multimodal human-computer environment despite their known limitations ? \end{itemize}
Affiliations:
- France
- Grand Est, Lorraine (région)
- Nancy
- Centre national de la recherche scientifique, Institut national de recherche en informatique et en automatique, Laboratoire lorrain de recherche en informatique et ses applications, Université de Lorraine
Links toward previous steps (curation, corpus...)
- to stream Crin, to step Corpus: 000F16
- to stream Crin, to step Curation: 000F16
- to stream Crin, to step Checkpoint: 003713
- to stream Main, to step Merge: 00DD33
- to stream Main, to step Curation: 00D456
Le document en format XML
<record><TEI><teiHeader><fileDesc><titleStmt><title xml:lang="en" wicri:score="274">Multimodal Designation : Experimental Data on User Strategies</title></titleStmt><publicationStmt><idno type="RBID">CRIN:carbonell92a</idno><date when="1992" year="1992">1992</date><idno type="wicri:Area/Crin/Corpus">000F16</idno><idno type="wicri:Area/Crin/Curation">000F16</idno><idno type="wicri:explorRef" wicri:stream="Crin" wicri:step="Curation">000F16</idno><idno type="wicri:Area/Crin/Checkpoint">003713</idno><idno type="wicri:explorRef" wicri:stream="Crin" wicri:step="Checkpoint">003713</idno><idno type="wicri:Area/Main/Merge">00DD33</idno><idno type="wicri:Area/Main/Curation">00D456</idno><idno type="wicri:Area/Main/Exploration">00D456</idno></publicationStmt><sourceDesc><biblStruct><analytic><title xml:lang="en">Multimodal Designation : Experimental Data on User Strategies</title><author><name sortKey="Carbonell, N" sort="Carbonell, N" uniqKey="Carbonell N" first="N." last="Carbonell">N. Carbonell</name></author><author><name sortKey="Pierrel, J M" sort="Pierrel, J M" uniqKey="Pierrel J" first="J.-M." last="Pierrel">Jean-Marie Pierrel</name><affiliation><country>France</country><placeName><settlement type="city">Nancy</settlement><region type="region" nuts="2">Grand Est</region><region type="region" nuts="2">Lorraine (région)</region></placeName><orgName type="laboratoire" n="5">Laboratoire lorrain de recherche en informatique et ses applications</orgName><orgName type="university">Université de Lorraine</orgName><orgName type="institution">Centre national de la recherche scientifique</orgName><orgName type="institution">Institut national de recherche en informatique et en automatique</orgName></affiliation></author></analytic></biblStruct></sourceDesc></fileDesc><profileDesc><textClass></textClass></profileDesc></teiHeader><front><div type="abstract" xml:lang="en" wicri:score="2997">We have designed an experiment on the `Wizard of Oz' paradigm. Ten subjects interacted with various standard applications (MacDraw, Word,...) through a dialogue interface which includes\, : \begin{itemize} \item[-]software driven keyboard and graphical display \item[-]simulated speech input and output \item[-]a touch panel (for 2xD selection and drawing) with additional simulated functions. \end{itemize} Experimental results are discussed with respect to the following issues\, : \begin {itemize} \item[-]to what extend does multimodality influence user designation strategies ? Does speech play as prominent a role here as in human dialogue ? Is anaphora used as frequently ?... \item[-]How do subjects combine speech and pointing (concurrently or sequentially) ? Do they associate deictics with gestures ? Or do they replace words such as ``her{e}'', ``this'', etc., by pointing ? \item[-]At which level should incoming information from various modes be synchronized and merged ? What form and granularity should be resulting unified representation take ? \item[-]Are current models of linguistic reference mechanisms (cf. for instance, Sidner's and Grosz's models) applicable in a multimodal human-computer environment despite their known limitations ? \end{itemize}</div></front></TEI><affiliations><list><country><li>France</li></country><region><li>Grand Est</li><li>Lorraine (région)</li></region><settlement><li>Nancy</li></settlement><orgName><li>Centre national de la recherche scientifique</li><li>Institut national de recherche en informatique et en automatique</li><li>Laboratoire lorrain de recherche en informatique et ses applications</li><li>Université de Lorraine</li></orgName></list><tree><noCountry><name sortKey="Carbonell, N" sort="Carbonell, N" uniqKey="Carbonell N" first="N." last="Carbonell">N. Carbonell</name></noCountry><country name="France"><region name="Grand Est"><name sortKey="Pierrel, J M" sort="Pierrel, J M" uniqKey="Pierrel J" first="J.-M." last="Pierrel">Jean-Marie Pierrel</name></region></country></tree></affiliations></record>Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Wicri/Lorraine/explor/InforLorV4/Data/Main/Exploration
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 00D456 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/Main/Exploration/biblio.hfd -nk 00D456 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien
|wiki= Wicri/Lorraine
|area= InforLorV4
|flux= Main
|étape= Exploration
|type= RBID
|clé= CRIN:carbonell92a
|texte= Multimodal Designation : Experimental Data on User Strategies
}}
| This area was generated with Dilib version V0.6.33. |  |